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FOREWORD 


The  purpose  of  this  study  was  to  evaluate  the  effectiveness  and 
efficiency  of  the  PLATO  IV  Plasma  terminal  from  an  instructional  point 
of  view.  The  instructional  basis  for  this  evaluation  consisted  of  six 
mini-CAl/CMI  programs  developed  by  the  instructional  programming 
staff  of  the  U.  S.  Army  Computerized  Training  System  Project,  Fort 
Monmouth,  N.  J.  The  primary  instructional  device  which  conveyed 
these  instructional  materials  consisted  of  four  PLATO  IV  terminals 
which  are  interfaced  with  the  PLATO  IV  Computer-based  Educational 
System  at  the  University  of  Illinois  via  telecommunication  lines . The 
basic  results  indicated  that  while  peer  training  achievement  was  equiva- 
lent to  individual  training  achievement,  peer  training  was  conducted  in 
significantly  less  time  than  individual  training. 
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1.  INTRODUCTION 

The  purpose  of  this  study  was  to  evaluate  the  effectiveness  and  efficiency  of 
the  PLATO  IV  (Programmed  Logic  for  Automatic  Teaching  Operation)  Hasma 
terminal  from  an  instructional  point  of  view.  The  instructional  basis  for  this 
evaluation  consisted  of  six  mini-CAl/CMI  programs  developed  by  the  instructional 
programming  staff  at  the  U.  S.  Army  Computerized  Training  System  (CTS)  Pro- 
ject, Fort  Monmouth,  N.  J.  The  primary  instructional  medium  which  conveyed 
most  of  the  instructional  materials  consisted  of  four  PLATO  IV  Plasma  terminals 
which  are  interfaced  with  the  PLATO  IV  Computer-based  Educational  System  at 
the  University  of  Illinois  via  telecommunication  lines . The  scope  of  evaluating 
the  effectiveness  and  efficiency  of  the  PLATO  IV  terminals  for  presentation  of 
instructional  materials  included: 

A.  An  analysis  of  learning  gain  (operationally  defined  as  the  difference 
between  pre  and  posttest  scores)  on  students  training  alone  at  the  PLATO  terminal 
(Individual -Learning,  "I-L",  mode); 

B.  An  analysis  of  learning  gain  on  students  training  together  at  a PLATO 
terminal  (Peer-Learning,  "P-L",  mode); 

C.  Comparison  between  individual  versus  peer-learning  groups  on:  learning 
gain,  final  achievement  and  completion  time  scores . 

2.  HYPOTHESES 

It  was  hypothesized  that: 

I.  The  difference  between  the  pre  and  posttest  achievement  means  within 
the  two  study  groups  will  be  significant; 

n.  The  difference  between  the  learning  gain  means  between  the  two  study 
groups  will  not  be  significant; 

HI.  The  difference  between  the  posttest  achievement  means  between  the  two 
study  groups  will  not  ba  significant; 

IV.  The  difference  between  the  course  total  time  means  and  sub-lesson 
means  will  not  be  significant. 

For  purposes  of  conducting  and  interpreting  the  statistical  analyses,  the  null 
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hypothesis  for  each  of  the  above  expectations  will  be  conventionally  stated  that  the 
difference  between  any  two  tested  means  will  be  nonsignificant. 

3 . BACKGROUND  AND  SIGNIFIC ANC  E 


t 


f 

$ 


f 

j 

t 


The  CTS  Project  ha_  been  engaged  in  the  use  and  testing  of  four  PLATO  IV 
terminals.  These  terminals  were  designed  for  use  in  the  PLATO  IV  Computer- 
based  Educational  System  by  the  Computer-based  Education  Research  Laboratory 
(CERL)  at  the  University  of  Illinois. The  CTS  investigation  of  these  terminals 
is  being  performed  in  conjunction  with  a program  sponsored  by  the  Advanced  Re- 
search Projects  Agency  (ARPA)  of  the  Department  of  Defense.  This  program  ori- 
ginated from  a proposal  by  the  University  of  Illinois  for  the  evaluation  of  their 
PLATO  IV  Computer-based  Education  System  for  a Volunteer  Armed  Services 
Personnel  Program.  ( ^ The  four  plasma  display  terminals  were  allocated  to  CTS 
by  ARPA  initially  for  the  primary  purpose  of  training  instructional  programmers 
preliminary  to  the  acquisition  of  the  Army's  Computerized  Training  System  (CTS) 
due  to  be  fully  installed  approximately  by  May  1975.  However,  the  development 
of  a plan  for  a more  extensive  use  and  evaluation  of  the  PLATO  IV  plasma  ter- 
minal was  considered  necessary  ^ The  task  confronting  the  CTS  Evaluation  Di- 
vision is  to  assess  the  planned  alternative  uses  to  which  the  PLATO  terminals  can 
be  put  and  determine  the  order  which  it  considers  most  expedient  for  their  evalu- 
ation. This  determination  must  be  tempered,  of  course.iby  the  primary  commit- 
ment of  the  CTS  Evaluation  Division,  i.e. , to  develop  and  implement  plans  for 
the  test  and  evaluation  of  the  Army's  own  CTS  Project.  The  alternative  selected 
for  this  initial  use  and  evaluation  of  the  PLATO  terminal  comprises  the  topic  of 
this  study. 

In  consonance  with  the  objectives  of  the  PLATO  IV  demonstration  and  evalu- 
ation program,  as  proposed  by  the  CERL  department  of  the  University  of  Illinois, 
the  alternative  uses  of  the  PLATO  IV  terminals  submitted  by  CTS  include  the 
following: 

A.  Prepare  concise  materials  aimed  at  the  development  of  technical  and 
occupational  skills; 

B.  Train  instructional  programmers  in  the  development  of  instructional 
materials ; 


C . Develop  techniques  and  procedures  for  developing  and  presenting  computer- 
based  course  materials; 

D.  Evaluate  system  and  terminal  reliability; 
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E.  Evaluate  the  effectiveness  and  efficiency  of  the  PLATO  IV  Plasma  ter- 
minal from  an  instructional  point  of  view. 

In  order  to  expedite  the  above  noted  PLATO  terminal  uses  and  evaluation,  each 
alternative  was  defined  as  a task  area  which  then  was  further  subdivided  into 
specific  subtasks  of  manageable  proportions  for  assessment  purposes.  For 
example,  one  of  the  task  areas,  which  corresponds  with  objective  "E”  above, 
includes  three  subtasks  related  to  the  evaluation  of  the  effectiveness  and  efficiency 
of  the  course  materials  developed  for  presentation  by  the  system:  (a)  evaluation 
of  course  materials;  (b)  student  acceptance;  and,  (c)  instructor  acceptance.  Due 
to  several  readily  available  mini-lessons  made  possible  by  implementation  of 
alternative  "A”  above,  subtask  "a"  (evaluation  of  course  materials)  was  selected 
as  the  next  PLATO  area  for  investigation.  The  instructional  materials  evaluated 
were: 


o Introduction  to  PLATO  IV  Plasma  Terminal 
o First  Aid 
o Ohmfe  Law 
o Series  Circuits 
o Parallel  Circuits 
o Troubleshooting 

For  study  purposes  these  six  mini-lessons  were  organized  into  a complete  self- 
paced  instructional  package. 

4.  PROCEDURE 

A.  Sampling.  The  total  study  sample  consisted  of  87  students.  This  sample 
was  subdivided  into  two  study  groups:  (a)  individual -learning  (I-L)  group:  n = 35; 
and,  (b)  peer-learning  (P-L)  group:  n = 52  (26  pairs).  All  students  were  randomly 
selected  from  regular  Army  personnel  who  were  in  a holding  status  in  preparation 
for  initial  or  further  MOS  (Military  Occupational  Specialty)  training  at  the  US 
Army  Communications  Electronics  School  (USACES),  Fort  Monmouth,  N.  J., 
and  also  randomly  assigned  to  the  two  study  groups. 

B.  Briefing.  Students  were  briefed  by  CTS  staff  personnel  concerning  class- 
room modus  operandi:  e.g.,  rest  breaks,  sign-on  procedures  to  the  PLATO  IV 
terminal,  and  relationship  of  pairs  in  the  peer-learning  mode. 


C.  Instruments . Two  achievement  instruments  were  employed:  (a)  a pre- 
test on  achievement;  and,  (b)  a posttest  on  achievement.  The  pre  and  posttests 
were  administered  immediately  prior  to  and  following  the  student  learning  task. 
These  tests  were  identical  except  for  rewording  of  instructions  as  appropriate. 

D.  Instructional  Materials.  The  instructional  materials  consisted  of  three 
Direct  Current  Fundamentals  lessons  using  a CAI  mode  of  presentation:  one 
Troubleshooting  Procedures  lesson  using  a CDI  mode  of  presentation;  and,  one 
First  Aid  and  Safety  lesson  using  a CMI  mode  of  presentation.  An  introductory 
lesson  preceded  these  lessons,  orienting  the  students  on  the  use  of  the  PLATO  IV 
terminal  keyboard,  making  corrections  and  sending  answers  to  the  computer.  The 
instructional  package  w is  structured  as  follows:  (a)  Introduction;  (b)  First  Aid/ 
Safety  or  Troubleshooting;  (c)  Ohmfe  Law;  (d)  Series  Circuits;  (e)  Parallel  Cir- 
cuits; and,  because  of  necessary  scheduling  of  students  due  to  lack  of  availability 
of  secondary  devices,  First  Aid/Safety  or  Troubleshooting  was  given  last  to  some 
students . 

E.  Statistical  Design /Analysis.  In  order  to  test  the  null  hypothesis:  (i.e., 
no  difference  exists  between  the  obtained  means)  for  each  of  the  hypotheses  stated 
in  section  three  above,  the  "t"  test  of  significance  was  employed.  ( ) As  appro- 
priate, two  types  of  "t"  tests  were  used:  (a)  "t"  test  for  the  difference  between 
correlated  means:  applied  to  the  pre  vs  posttest  means  (same  subjects);  and, 

(b)  "t"  test  for  the  difference  between  independent  means:  applied  to  the  individual 
vs  peer-learning  means  (different  subjects).  Where  the  assumption  for  homo- 
geneity of  variances  was  rejected,  the  required  "df"  was  adjusted  by  the  Welch 
test  prior  to  the  "t"  test.  ( 5 ) Since  this  investigation  represents  one  of  a series 
of  exploratory  PLATO  terminal  studies,  the  .05  level  of  significance  was  adopted. 

5.  RESULTS 

The  findings  relating  to  the  nature  of  the  study  samples  and  to  the  hypotheses 
of  the  study  are  contained  in  Table  1-4.  Table  1 contains  information  on  the  pre- 
training characteristics  of  the  two  study  groups  (I-L/P-L).  As  indicated,  no 
significant  difference  (p>  . 05)  was  obtained  between  the  two  groups  on  three 
matching  variables:  EL,  GT,  and  Pretest  regarding  both  mepn^  and  S.  D.'s 
(except  for  the  EL  S.D.).  From  this  data,  it  was  concluded  that  the  two  study 
groups  were  matched  sufficients  ;o  warrant  further  statistical  analyses  of  the 
stated  hypotheses . 


Table  1 

Individual/Peer  Group  Pre-Training  Characteristics 


Matching  Individual  Peer 


Variable 

N 

Mean 

SD 

N 

Mean 

SD 

t1 

P 

EL2 

35 

115.23 

11.60 

52 

117.75 

16.51 

RBI 

.41 

'* 

J 

GT2 

35 

110.00 

13.23 

505 

113.08 

16.37 

. 924 

.36 

Pretest2 

35 

10.86 

3.66 

52 

11.19 

4.28 

.38 

.71 

\ k test:  for  independent  means 

2See  Glossary 

3 Assumption  of  equal  variances  rejected:  df  adjusted  by  Welch's  test 
^Assumption  of  equal  variances  accepted:  hence,  variances  pooled 
^Two  scores  were  unavailable 

Tables  2-4  contain  the  results  pertaining  to  the  hypothesis  testing  regarding 
achievement  and  completion  time  within  and  between  the  two  study  groups.  The  pre 
vs  posttest  achievement  results  within  the  two  groups  are  contained  in  Table  2.  As 
indicated,  the  mean  difference  between  the  pre  and  posttest  measures  was  highly 
significant  for  both  groups  (p^.001). 

Table  2 


Significance  of  Pre  vs  Posttest  Achievement:  Within  Groups 


Study 

Group 

N 

Pretdst 
Mean  SD 

Posttest 
Mean  SD 

t1 

P 

Individual 

Peer 

35 

52 

10.86 

11.19 

3.66 

1.28 

14.31 

13.92 

3.06 

3.68 

8.13 

7.67 

.001 

.001 

*t  test:  for  correlated  means 


The  learning  gain  (posttest  - pretest)  and  posttest  achievement  results  between 
the  two  groups  are  contained  in  Table  3. 


Table  3 


Significance  of  Learning  Gain/' Post  Test  Achievement:  Between  Groups 


Study 

Individual  Gp. 

Peer  Gp. 

1 

Variable 

N 

Mean  SO 

N Mean 

SD 

t1 

P 

Learning  Gain 

35 

3.63  2.32 

52  2.85 

2.40 

1.51 

. 13 

Posttest 

35 

14.34  3.06 

52  13  92 

3.68 

.56 

.57 

k test:  for  independent  means 


As  indicated  the  mean  difference  between  the  two  groups  on  both  learning  gain  and 
posttest  was  nonsignificant  <p  > 05) 

The  separate  mini-lesson  and  total  package  completion  time  results  between  the 
two  groups  are  contained  in  Table  4 

Table  4 


Significance  of  Mini -Lesson/Total  Package  Time:  Between  Groups 


Mini- 

Lesson 

Individual  Gp 
N Mean 1 SD 

Peer  Gp 

N Mean  SD 

t2 

P 

Introd.  PLATO  IV 

35 

9.01 

2 .68 

26 

8.42 

2.27 

.91 

.37 

First  Aid/Safety 

35 

30. 85 

18. 09 

26 

22.46 

17.77 

1.81 

.08 

Ohnrfs  Law 

35 

28. 13 

9.85 

26 

23. 9i 

8.02 

1.78 

.08 

Series  Circuits 

35 

17.31 

7. 89  3 

26 

16.50 

4. 393 

.52 

.61 

Parallel  Circuits 

35 

62.87 

23. 2l3 

26 

53.98 

13. 423 

1.88 

.07 

Troubleshooting 

35 

36.54 

8.36 

26 

32.96 

10.13 

1.51 

.14 

Total  Package 

35 

3.084 

.87 

26 

4 

2.61 

.69 

2.30 

.03 

*#  of  pairs  used:  most  conservative  N for  peer  group  (using  X time  of  pairs) 

2t  test:  for  independent  means 

•^assumption  of  equal  variances  rejected:  df  adjusted  by  Welch  method 
4total  time:  in  hours /mini -lesson  time:  in  minutes 

As  indicated,  the  mean  difference  between  the  two  groups  on  completion  time  for 
each  of  the  mini-lessons  was  non-significant  (p>  ,05)  although  three  lessons 
approached  significance.  Further,  the  mean  difference  between  the  groups  on  total 
completion  time  (across  all  lessons)  was  significant  (p<  . 05). 


6.  SIGNIFICANCE  OF  FINDINGS 


An  overall  assessment  of  the  above  results  indicates  the  following: 

A.  The  individual  and  peer  groups  were  adequately  matched  for  compara- 
tive purposes.  (Table  1) 

B.  Both  the  I-L  and  P-L  groups  demonstrated  a significant  degree  of 
learning  between  their  pre-posttest.  (Table  2) 

C.  Comparatively,  both  groups  demonstrated  an  equivalent  degree  of 
learning  gain  (posttest  - pretest).  (Table  3) 

D.  Both  groups  demonstrated  an  equivalent  degree  of  posttest  achievement 
in  a test  covering  all  mini-lessons  taken.  (Table  3) 

E.  The  peer  group  completed  the  total  package  of  instructional  material 
in  significantly  less  time  than  the  individual  group.  (Table  4) 

Thus,  with  respect  to  the  stated  hypotheses  (Part  2),  the  following  is  noted: 

Hypothesis  I:  Null  hypothesis  rejected.  As  anticipated,  a significant  dif- 
ference was  obtained  between  the  pre -posttest  achievement  means  within  the  two 
study  groups.  (Table  2) 

Hypothesis  II:  Null  hypothesis  accepted.  The  difference  between  the 
learning  gain  means  between  the  two  study  groups  was  not  significant.  (Table  3) 

Hypothesis  HI:  Null  hypothesis  accepted.  The  difference  between  the  post- 
test  achievement  means  between  the  two  groups  was  not  significant.  (Table  3) 

Hypothesis  IV:  Null  hypothesis  accepted  for  mini-lessons,  but  rejected  for 
total  instructional  package.  The  difference  between  each  mini -lesson  mean  between 
the  two  study  groups  was  not  significant;  however,  contrary  to  expectations  the 
difference  between  the  total  course  means  was  significant.  (Table  4) 

7.  CONCLUSIONS 

Based  upon  the  conduct  of  this  study  the  following  conclusions  are  made: 

A.  Specific: 

(1)  The  basic  potential  of  the  PLATO  IV  Plasma  terminal  as  an  instructional 
device  was  supported  by  the  significant  learning  gain  observed  between  the  pre  and 
post- achievement  scores  for  both  study  groups. 
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(2)  The  basic  potential  of  peer-learning  to  enhance  student  achievement 
in  contrast  with  individual-learning  in  computer-based  instruction  was  not  sup- 
ported by  the  findings.  Both  groups  achieved  equally  as  well  on  both  their  learn- 
ing gain  and  final  achievement  scores. 

(3)  The  potential  for  the  peer-learning  technique  to  accelerate  student 
learning  was  supported  by  the  findings.  The  peer  group  completed  the  learning 
package  in  significantly  less  time  than  the  individual  group. 

B.  General: 

/ 

The  PLATO  IV  Plasma  terminal  provides  a very  useful  medium  for  the 
conduct  of  trainingAearning  research.  Further,  its  capability  for  a wide  range 
of  statistical  analysis  was  noted  and  utilized  in  this  study.  Therefore,  the  high 
potential  of  such  computer-based  interactive  display  devices  is  to  be  recognized 
and  exploited. 

8.  GLOSSARY 

o PLATO:  Program  Logic  For  Automatic  Teaching  Operation. 

o Plasma:  A special  type  of  display  screen  which  does  not  require  regen- 
eration of  the  display  signal  such  as  is  required  by  a conven- 
tional CRT  scope. 

o CAI:  Computer  Assisted  Instruction  (i.e.,  instruction  is  presented 

on  line  via  a computer  terminal). 

o CDI;  Computer  Directed  Instruction  (i.e. , instruction  is  presented 
off  line  but  control  and  direction  is  maintained  on  line). 

o CMI:  Computer  Managed  Instruction  (i.  e.,  instruction  is  presented 

off  line  apart  from  a computer  terminal  and  not  under  its  im- 
mediate control  except  for  periodic  testing/prescription. 

t 

o CTS:  Computerized  Training  System.  A prototype  Army  Project 

which  will  combine  CAl-CMI-CDI  into  one  instructional  system. 

1 

o Achievement/Learning  Gain:  The  difference  between  the  pre  and  posttest 
scores . 

o Secondary  Device:  An  orv6ff  line  instructional  device  used  as  an  adjunct 
device  for  training  in  addition  to  a primary  medium  of  instruc- 
tion. 
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o EL:  Electronics  Repair  - Subtest  of  the  Army  Classification  Battery 

Subtests . 

o GT:  General  Technical  - Subtest  of  the  Army  Classification  Battery 

Subtests . 

o Pretest/Posttest  - Special  Achievement  test  developed  by  in-house  per- 
sonnel . 
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